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MJSl'RACP Thi< paper outlines a three-step plan for generating English text from any semantic 
'representation by applying a set of syntactic transformations to a collection of kern:! sentences. The paper 
fa uses on describing a program which realizes the third step of this plan. Step. Ojic separates the given 
representation into groups and generates from each group a set of kernel sentences, ^.tefi inmost oeciue 
based upon both syntactic and thematic considerations, the set of transformations that should be performed 
upon each set of kernels. The output of the first two steps provides the "I ASK' for Step Ihree. bach 
element of the TASK corresponds to the generation of one English sentence, and in mrn may he defined as a 
triple consisting of: (a) a list of kernel phrase markers; (b) a list of transformations to be performed upon the 
list of kern<dsf(c) a "syntactic separator" to separate or connect generated sentences. Step Jthjee takes as 
input the results of Step One and Step Two. The program which implements Step Ihrcc "reads the 1 ASK, 
executes the transformations indicated there, combines the altered kernels of each set into a sentence, 
performs a pronominali/.ation process, and finally produces the appropriate English word string I his 
nporoach subdivides a hard problem into three more manageable and relatively independent pieces. It uses 
linguistically motivated theories at Step Two and Step Three. As implemented so tar, Step lhrcc is small 
and highly efficient The system is flexible; all the transformations can be applied m any order. J he system 
is general; it can be adapted easily to many domains. Below is an actual example of English text generated 
by the program from the kernels and transformations of an appropriate input TASK: 

"At the beginning of the norv Lady Macbeth is bothered by the fact that Macbeth is not the king. Macbeth who was 
a nobleman is persuaded by her to murder the king with a knife because she wants Macbeth to be the king. She dies and 
Macbeth becomes unhappy. Macduff didn't see Macbeth murder the king. In the end Macbeth is killed by Macduff who 
was a good friend of the king. Were there some other stories written by Shakespeare?" 
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§0. Introduction 

Suppose that a computer contains a semantic representation of a certain seque ice of events or facts. 
For many reasons, it is useful to generate English text from such a representation. This paper 
outlines a three-step plan for generating English text from any semantic representation by applying 
a set of syntactic transformations to a c< llection or kernel sentences or phrase markers. 1 The paper 
fxuses on describing a program called GEN which realizes the third step of this plan. 

Slec One of the Language Gcncution Procedure (LGP) separates the given semantic 
representation into groups and generates from each group a set of kernel phrase markers. A phrase 
marker can be used in one of several syntactic roles: a matrix clause K Q , an embedded clause K r or 
a relative clause K 2 . The role of a given phrase marker must be specified in Step One. 

Sten Iwo of the LGP must decide, based upon both syntactic and thematic considerations, the set 
^ of transformations that should be performed upon each set of kernels. 

The output of the first two steps provides the input for Step Three. We will sometimes refer to this 
input as the "TASK" for Step Three. Each element of the TASK corresponds to the generation of 
one English sentence, and in turn may be defined as a triple consisting of: 

(a) a list of kernel phrase markers generated by Step One; 

(b) a list of transformations, obtained from Step Two, to be performed upon the list of 

kernels; 

(c) a "syntactic separator" (punctuation mark, conjunction, etc.) to separate or connect 

generated sentences. 

Step Three takes as input the results of Step One and Step Two. The program GEN which 
implements Step Three of the generator "reads" the TASK, executes the transformations specified 
there, combines the altered kernels of each set into a sentence, performs a pronominalization 
process, and finally produces the appropriate English word string. 
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1. The definition and the structure of kernel phrase markers (Semitic Frame Structure) is described in Section I. 

2. A comprehensive review of previous approaches to language generation can be found in [McDonald 1980]. 



K.atz - 3 - in traduction 



.3 



For example, given the following kernels 

K n =.a young woman asked it (1) 

K^ = this man ate the cake 

the program can apply different sets of transformations for altering the individual sentences or 
combining them. Among the possible outputs are: 4 

1. After 0-NP -TO : A young woman asked, this man to cat the cake. 

2. After QUKSTION: Did a young woman ask this man to eat the cake? 

3. After NOT: Did a young woman ask this man not to eat the cake 7 (2) 

4. After PASSIVE: Was this man asked by a yoiuig woman no^o ea^hc cake? 

5. After N'T: Wasn't this man asked by a young woman not to eat the (pake? 
Suppose that the program GEN takes as input the following TASK: 

TASK1 - ((K Q K) (0~np { to l Question) (?)) 

According to this TASK, the program applies the transformation 0-np^to to the embedded clause 
K and the transformation Question to the matrix clause K n . Then the altered kernels are combined 
and the resulting output is: "Did a young woman ask this man to eat the cake?" which is sentence 
#2 in (2). If, for instance, we want to obtain sentence #5 from the set (2) above, the input TASK 
should be: 

TASK2 - ((K K x ) {Q-n P{ to x Question Not x M$m N't) (?)) 

The Hist step of the Eanguage Generation Procedure uses three different plasses of syntactic 
operations to "solve" the TASK provided by Step One and Step Two: the system of optional 
commutative Transformations^ the set of Transformational Filters whose application is obligatory 
only if certain conditions are met, and the set of intrinsically ordered, obligatory Adjustments. 



3. The word it is used here as a joining point. 

4. For convenience, we append "1" to the name of a tnuisfpnrnatipn which will be appliecl to an embedded clause, m$ 
"2" to a iransfbrmation that will be appliecl to a relative clause. Nothing is appended to' die matrix clause, TJie 
significance of the names of transfpnuatipns, sijch as ONf^-TO, will be cxplaincci below in Section 6. 
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^N Helow is an aciuai example of Fnglisli :c\t generated by the program Ol-N I'rom the kernels and 

transformations of an appropriate input TASK: 5 

An old professor wanted .1 large Rnglish class to learn a story about 
Macbeth. He didn't notice a young man and a young lady eating a huge 
cake under the desk. They were in danger, weren't they? Fortunately the 
people who loved the story ;..boul Macbeth did not see them either. Hear it 
now! At the beginning of tic story Lady Macbedi is bothered by the fact 
that Macbeth is 'not the king. Macbeth who was a nobleman is persuaded 
by her to murder the king with a knife because she wants Macbeth to be 
the king. She dies and Macbeth becomes unhappy. Macduff didn't see 
Macbeth murder the king. In the end Macbeth is killed by Macduff who 
was a good friend of the kiig. Were there some other stories written by 
Shakespeare? 6 

The pronouns found in this example we:e not present in the input TASK, but were created by the 
program. 7 

Among the advantages of this approach are: 

f~*\ - it nicely subdivides a hard problem into three more manageable pieces, such that each is 

relatively independent of the others 

- it uses linguistically motivated theories at Step Two and Step Three of the LGP 

- as implemented so far, Step Three is small and highly efficient 

- the system is flexible; all the transformations can be applied in any order 

- the system is very general; it can be adapted easily to many domains, 
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5. The following fragments show the structure of the TASK: 

(K = An old professor wanted it; K^ A large English class learns a story about Macbeth) (0-np^to^ (.) 

(K = Macduff saw it; Kj = Macbeth murdered the king) (AT/ 0-np^inf^ (.) 

(K = In the end Macduff kills Macbeth; K 2 = Macduff was a good friend of the king) (Relative 2 Passive) (.) 

(K = Shakespeare wrote some other stories) {Question Passive There) (?) 

6. The author apologizes for possible historical inaccuracy in the computer output. 

7. The pronominalization procedure is described in the Appendix I. 
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§ 1 , Semantic Frame Structure 

We will assume that the input semantic representation consists of a. set of frames. 8 Step One of the 
Language Generation Procedure builds from the given representation a set of Kernel phrase markers 
using three types of templates (noun-template, verb-template, adverb-template) and two operations 
(concatenation and conjunction) that assemble them. The structure of the templates is shown 
below: 

noun-template (NT) = (prep* dot* adj* noun) 

verb-template (VT) = (tense au>.i aux2 aux3 verb) 

adverb-template (AT) = (mod adverb) 

Wzrs' prep, del, adj\ aux, mod arc, respectively, abbreviations for preposition, determiner, adjective, 
auxiliary and modifier. The superscript * indicates that a string of one or more symbols or their 
conjunction is allowed. Tense also carries the grammatical features of W x -- its number, person, 
and gender. 

Each template is implemented as <\ list of pairs, an association list. The first element of the pair is 
the name of the constituent, the second is its value. All constituents are optional. If any constituent 
is absent, its value in the template is nil. 

Given below are some sample templates:. 

NT = ((prep nil) (dct a) (adj (young pretty)) (noun lady)) "a young pretty lady" 

NT =.((prcp with) (dct (all the)) (adj nice) (noun books)) "with all the nice books" 

NT = ((prep (from out of)) (dct the) (adj nil) (noun clar|cncs5?» "from out of the darkness" 

VT = ((tense past) (auxl can) (aux2 have) (aiix3 nil) (verb notice)) "could have noticed" 

AT = ((mod very) (adverb well)) "very well" 

The fallowing two operations are allowed: 




process the kernel, phrases. The description of the parser can he found in the Appendix 2. 
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f~\ 1. Concatenation : CONC(Xl X2) --> XI X2 

2. Conjunction : CONJ (XI X2) --> XI conj X2 

where XI and X2 are two templates of the same type, and conj is a conjunction such as, and, or, etc. 

1 he structure of the frames can be defined in terms of the templates and operations, as follows: 

Noun- frame (NF) is any appropriate 9 sequence of applications of the operations CONC and 
CONJ applied to the noun-template NT. 

Verb- fram e (VF) and adverb- frame (AF) are defined in the same manner, as a sequence of 
applications of CONC and CONJ applied to VT and AT, respectively. 
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The noun-frame will be called prepositionless if it does not begin with a preposition. 
For example: 

NF = ((prep nil) (det nil) (adj nil) (noun Ivan) (conj and) 

(prep nil) (det nil) (adj nil) (noun (Maria)) = "Ivan and Maria". 

Eiach of the prepositionless noun-frames in a sentence has a particular semantic role associated with 
it: agent, goal, or theme. 

Agent is a thing that causes the action to occur. 
Goal is the recipient or the beneficiary of the action. 
Theme is a thing that undergoes a state of change. 

As an example, in the sentence "Ivan gave Maria all his money", Ivan is the agent who causes the 
action to happen; Maria is the goal as the beneficiary of his action; and all his money is the theme 
that transfers from Ivan to Maria. 

To construct a kernel phrase marker we have to put together a subset of the following set of frames: 

N pinitial jsjpageni^ ^psoa^ N plhci™ Np final , AF iniUal , AF m ° dial , AF fmal , VF (3) 

Here NF agent , NF 8oal , and NF theme are noun frames that play, respectively, the roles of agent, goal 



£~\ 9. The present paper will not discuss restrictions on the usage of these two operations. This issue properly belongs to 

Step One of the Language Generation Procedure. 
10. In the implementation we have assumed that the verb-frame VF = tense auxl aux2 aux3 verb. 
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or theme m a sentence; 11 NF iT,i1ial and NF iln;,! are noun frames that will be transformed later into 
the initial and final prepositional phrases; AF ini, H AF medial , and AF finnl are adverb frames that will 
be transformed into adverbs in initial, nedial, and final positions. All these elements are optional. 

In the actual implementation kernel pi rase markers have the structure of an association list. We 
will call it a Semantic Frame Structure (SIS). The Fnglish word string corresponding to the 
Semantic Frame Structure of a kernel phrase marker we will call a kernel sentence. 

For instance, the Semantic Frame Structure for the kernel sentence "Yesterday the young man 
bought Maria a beautiful present'' is: 

.. :((AF inilial ((mod nil) (adverb yesterday))) 

(NF agent ((prep nil) (det the) (adj young) (noun man))) 
(VF ((tense past) (auxl nil) (aux2 nil) (aux3 nil) (verb buy))) 
(NF oai ((prep nil) (det nil) (adj nil) (noun Maria))) 
(NF 1hcme ((prep nil) (det a) (adj beautiful) (noun present)))) 

A set of such Frame Structures together with a set of transformations to be performed upon them is 
the input to the program GEN. The program does not require any order of constituents in the SFS, 
but the following phrase structure rules are assumed for kernel sentences; 12 

KF -> SF VF CF 

SF -> N¥' mm NF agent (4) 

QP .-> Jsjpgoal jsjptheme J^pHnsl 

where KF stands for kernel frame, SF - subject frame, VF - verb frame, CF - complement frame. 
Given these phrase structure rules, the general form of a kernel phrase marker is; 

]\]pnitial jsjpngent yp jyjpgoal j^plhcme Jsjpfinal (5) 

As an example, here is the Semantic Frame Structure for the sentence "that young man with black 
eyes could have been teaching our class in Boston": 



11; In. Section 7 we will describe how the semantic roles associated with the noun-frames are used to define the 
transformation Dative Movement mil its iiUeraction with /to/ve 

12. Adverb-frames AF inilia] , AF nlcdial , and AF fma! have been, for simplicity, left out of the phrase structure rules. 
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f~\ ((NP ,sr!11 ((prep nil) (del that) (adj young) (noun man) 

(prep with) (del nil) (adj black) (noun eyes))) 

(VF ((tense past) (auxl can) (aux2 have) (aux'3 be) (verb teach))) (6) 

(NF thcm '((prep nil) (del our) (adj nil) (noun class))) 

( N pfinni (( prc p in) (det nil) (adj nil) (noun Boston)))) 

§2. Transformational Structure 

The Semantic Frame Structure provides a semantic description of a kernel sentence which includes 
constituents such as NF" 80 "', NF eo;l! , and NF' hcmc . Because these semantic constituents represent in 
some sense a part of the underlying "meaning" of the sentence, their value* do not change after 
applying transformations. However, the SFS does not give a syntactic representation complete 
enough to allow transformations to be directly applied. We must first construct an augmented 
representation from the Semantic Frame Structure, the Transformational Structure (TS), which 
gives a structural encoding of the information in the sentence. This structure will serve as the 
^""^ domain of application for all transfonr ations. The Transformational Structu ,-e consists of syntactic 

constituents such as noun phrases (NP), prepositional phrases (PP), auxiliary system, several dummy 
elements, etc. The process of building the Transformational Structure from the Semantic Frame 
Structure is described as follows: 

(a) The noun phrases and the prepositional phrases of the TS are derived from the noun frames of 
the SFS. Each noun phrase indicates a. certain fixed position in the Transformational Structure: 
NP -position, NP -position, or NP 2 -position. 13 Each noun phrase is associated with one of the 
prepositionless noun frames NP 86 *", NF 80al , or NF lhe,MC in the Semantic Frame Structure and 
derives its value from the noun frame. The value of a noun phrase is a "two-tuple"; it consists of a 
semantic value, which is taken from the name of the noun frame and which indicates the role that 
the noun phrase plays in the sentence: agent, goal, or theme, and a lexical value, which is the actual 
word string in the noun phrase. Transformations (for example, Passive or Dative Movement) may 
interchange the values of noun phrases; therefore, after such. a transformation has been applied, the 
affected noun phrase receives not only the new word string as its lexical value, but also the new 



n 



13. biter on by a reference lo a noun phrase NP r NP LJ . or NP 2 , we will mean the noun phrase which is located in Ore 
corresponding position in the Transformational Structure. For instance, reference to NPj calls for a noun phrase in the 
NP,-posilion in IheTS. 
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semantic role as its semantic value. In Section 7 we will describe how litis important feature is used 
to define the transformations of Dative Mo vement and Passive. 

We will assume that the noun phrases NP, NP , and NP initially obtain their values from the 
f-ames NF 8enl , NP oal , and NF lhcnie , respectively. If only two noun frames NP gcm ' and NF ,heme 
i" re present in the input Semantic Frame Structure, the corresponding Transformational Structure 
v/ill have only two NP-positions: NP and NP . M If there is only one noun frame NF agen V in the 
£-FS, there will be only one noun phrase- NP in the TS. The Semantic Frame Structure in the 
example (6) will be transformed to: 15 

((NP (That young man with black eyes)) 

(TENSE past) (AUX1 can) (AUX2 have) (AUX3 he) (VERB teach) (7a) 

(NP 2 (our class)) (PP final (in Boston))) 

(o) A special procedure, "affix stripping", is accomplished on the auxiliary elements of the 
verb-frame to separate each auxiliary verb from its affix. 16 The affixes of the auxiliaries Modal, BE, 
and HAVE are, respectively, 0, en, and ing. The notation reflects the fact that in an English 
sentence after a Modal comes an infinitive, after HAVE comes the past participle, and after BE 
comes. the progressive form of the verb [Chomsky 1957]. if the sentence has no auxiliary verbs in it, 
the auxiliary do (without an affix) is inserted as a value of the AUX1. 

((NP 1 (That young man with black eyes)) 

(TENSE past) (AUX1 can) (AFFIX1 0) (7b) 

(AUX2 have) (AFFIX2 en) (AUX3 be) (AFFIX3 ing) (VERB teach) 

(NP 2 (our class)) (PP nni1 (in Boston))) 

(c) Several dummy elements are inserted in the TS which are left unspecified 17 until the appropriate 
transformation activates them and assigns the necessary values. Two elements NEC! and NEG2 
that will be used in the contracted and full forms of English negative are inserted after the first 
auxiliary verb. COMP is inserted in the beginning of the structure and INFL - before the first 
auxiliary verb. These will be used in constructing different embedded clauses. Thus the Semantic 



14. This is the reason for having the obscure indices 1, 1 .5, and 2 for the noun phrases. 

15. in these diagrams we do not show the semantic values of the noun phrases. 

16. Flie inverse operation, Affix Hopping, which is performed after all the transformations have been applied, attaches 
every affix to the immediately following verb. 

17. in the implementation the virtues of unspecified elements NEG1, NEG2, COMP, and INFL are names of those 
elements. 



Kalz ' 10 - i 'ransibrmational Structure 

/*"•% rranie Structure (6) has now been transformed into Transformational Structure (7c) on which 

transformations can operate: 

((COMP comp) (NP (That young man with black eyes)) 

(TI-NSR past) (1NFL inll) (AUX1 can) (NBG1 negl) (NEG2 ncg2) (AFFIX1 0) (7c) 

(AUX2 have) (AFFIX2 en) (A JX3 he) (AFFIX3 ing) (VERB teach) 

(NP 2 (our class)) (PP n,lnl (in Boston))) 

The Transformational Structure of a kernel sentence is a flat list structure which suggests a more 
smple and flexible way to define an j perform the transformations. On the other hand, the 
sentence obtained after combining several kernel sentences is represented as an embedded list 
structure (tree structure). This allows the application of the transformational filters across the 
kernels (see Section 6), and also permits an easier interface with the results.. of. other researchers, for 
example, sentence internal pronominali/ation (see [Lasnik 1976], [Reinhart 1976], [Sidner 1979]). 

§3. Transformations and Adjustments 

/ 0\ Let K be a surface word string that corresponds to the input Semantic Frame Structure. In Section 

1 it has been described how the Semantic Frame Structure SFS(K) is mapped into the 
Transformational Structure TS(K). The Transformational Structure serves as the domain of 
application for all Transformations listed in the input TASK. However, after all the transformations 
have been applied, the resulting Transformation Structure TS (K) cannot yet be the source for the 
correct English word string. Additional "clean-up" operations on the Transformational Structure, 
Adjustments, must be employed in order to obtain the grammatical output -- the altered kernel K . 
Let us consider this process in detail: 

(a) The Semantic Frame Structure of the kernel sentence K is mapped {M} into a Transformational 

Structure TS(K). 

'(b) A set of transformations {T} is applied. Hach transformation operates on the Transformational 

Structure, alters it and passes the altered structure to the next transformation. 

(c) A set of special "clean-up" adjustments {A) is activated in order to get the terminal English word 

string K . The adjustments operate on the altered Transformational Structure TS (K). 
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The following diagram (8) illustrates this process: 

{M} {'I*} # {A} 
SFS(K) > TS(K) — > TS*(K) > K* (8) 
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Diagram (8) provides a way to define Transformations and Adjustments which shows an interesting 
and important distinction between them based on comparing the input kernel sentence K with the 
output word string K . 

Definitions: 

Assume that the set of transformations {T} is empty. A set of operations (A] on the 
Transformational Structure TS(K) of an input kernel sentence K will be ca led Adjustmen ts if in 
diagram (8) the following equality holds: K == K . 

An operation T on the Transformational Structure TS(K) of an input kernel sentence K will be 
called a T ransformation if in diagram '(!>) the following inequality holds: K & I( '". In this paper we 
will use the notation T(K) to refer to t/ie English word string that corresponds to the result of the 
action of the transformation T on TS(K). 

According to these definitions, such operations as Passive, Question, There Insertion™ etc. are 
Transformations because they alter the original sentence. For example, as the result of successive 
application of these transformations the sentence "Ivan ate a carrot" will be transformed into 
"A carrot was eaten by Ivan", "Was a oarrpt eaten by Ivan" and then to "Was there a carrot eaten 
by Ivan." The transformations are part of a planning vocabulary, that is, each of them must be 
listed in the input TASK. 

On the other hand, the obligatory operations like Affix Hopping, Do Deletion, N't Hopping, etc. 
together constitute the clean-up Adjustments 19 of the Transformational Structure whose goal is to 
obtain the necessary English output after all the transformations have been applied. They never 
appear in the input TASK. If the set of transformations {T} is empty, the original kernel sentence 
K will not be altered 

Adjustments are nieaning-preserying, purely syntactical operations on the Transformational 
Structure. Transformations, on the contrary, can affect the meaning (or emphasis) of a kernel 
sentence. In fact, the meaning of a sentence obtained after combining several kernels altered by 
transformations is built with the help of these transformations. In that sense, one can consider 
Transformations as semantic (meaning-altering) operations on the Transformational Structure. 



18. The description of these transformalions will be given in Section 7. 

19. Section 5 examines the Adjustments and the Separation and Ordering Constraints imposed upon them. 
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§ 4. Commutativity 
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D efinitions: 

n_omain of Definition fi(T) of a transformation T is the set of all sentences K such that T(K) is a 
g-ammatical sentence. The fact that the sentence K belongs to the domain of definition of the 
transformation T is expressed in the following way: K C 12(T). 

1 wo transformations Tj and T 2 are commutative with respect to a set of kernel phrase markers « if 
for each phrase marker K C K the following relations hold: 



aid 



K C W\\ K C ^(T 2 ), T^K) C fi< T 2 ), T 2 (K) C 0(1^ 



(9) 
(10) 



In other words, the transformations T, and T 2 are commutative if the equality (10) holds for the 
corresponding domains of definition of Tj and T r 

As an example, let us consider again the sentence K = "Ivan ate a carrot." The commutativity of 
the transformations T p = Passive and T Q = Question can be checked for this sentence because all 
the four outputs are grammatical and T p (T Q (K)) = T Q (T p (K)), i.e. we have the following 
commutative diagram (11): 



K = Ivan ate a carrot 



Passive I 



Question 



-> T (K) = Did Ivan eat a carrot 



Passive 



(ID 



4, Question * 

T p (K) = A carrot was eaten by Ivan > T p (T Q (K)) = Was a carrot eaten by Ivan 
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Considering another pair of transformations: T p = Passive and T. n = There Insertion shows that 
the commutativity of the transformations T p and T. n cannot be checked for the sentence K = 
"Ivan ate a carrot." The transformations can be applied in the order: 1. Passive, 2. There Insertion, 
resulting in: 
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■ T/K) = A carrot was eaten by Ivan. 
TXr/K)) = There was a carrot eaten by Ivan. 

But it is not possible to apply the transformations T p and T. n in the reverse order because the 
sentence K does not contain the verb b .-\ which is necessary for There Insertion to work. 1 his does 
not mean, however, that the two transit rmntions: Passive and There Insertion are not, or cannot be 
made, commutative. The previous example does not contradict our definition of comniutativity 
because the sentence K in this example does not belong to the domain of definition of the There 
Insertion transformation. 

A similar problem arises with the sentence: K = M A boy was eating the cake/' Here it is possible to 
apply either T p = Passive: 



or j = There Insertion: 



T p (K) = The cake was being eaten by a boy 



X , (K) = There was a boy eating the cake 



But we cannot apply There Insertion after Passive, nor can we apply Passive after There Insertion. In 
both cases the result will be unacceptable 20 because the noun phrase the cake is definite, but There 
Insertion is restricted to sentences with an indefinite first noun phrase: 

* There was the cake being eaten by a boy 
The following diagram (12) illustrates this example: 

There Insertion 
K = A boy was eating the cake - - — > 1 TJ (K) = There was a boy eating the cake 



Passive] \ Passive (12) 

I I 

I There Insertion v 

T (K) = The cake was being eaten by a boy --—__-—> * There was the cake being eaten by a boy 



20. The asterisk * before a sentence indicates that the sentence is "unacceptable", or ungrammatlcah 
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f^ Again, as in the previous example, the lact that we fan apply both T,, and 1 H to the sentence K, but 

cannot apply T to T (K.) or T p to T. n (K), does not mean that there is no commutativity in the 
system. It means only that in this case die sentence K is irrelevant to the quesnon of commutativity 
because K does not satisfy the conditions (9) specified in the definition of cc minutativity; K does 
not belong to the set of kernel phrase markers K with respect to which commmativity was defined. 

One of the requirements that we impose upon the system is the possibility to apply the 
transformations in any order (equality (10)). Once this is done, the domain m« mbership (conditions 
(9)) becomes crucial: all the sentences obtained at each step of the transformation derivation must 
be grammatical. 

Definition: 

N transformations T T 2 ... T are commutative with respect to a set of kernel phrase markers K if 
for any i and j the two transformations T. and T are commutative with respect 10 the set K and if for 
anym <N the result of application of any composition of m different transformations T. T. ...T 
to a sentence KCK: T. (T. ...(T. (K))...) is a grammatical sentence. 

'] h m 

^^ In this paper we will build a system of Commutative Transformations that will permit us to "solve" 

the TASK given by Step One and Step Two of the Language Generation Procedure and to generate 
corresponding English text. The commutativity of the system gives more flexibility to the first two 
steps' of the LGP. The decisions ofhow to separate the input semantic representation into groups of 
kernel phrase markers and which of the transformations to apply will not depend on the order of 
the transformations. It will be based only on the domain of definition of each particular 
transformation and on the meaning that this transformation adds to the meaning of the generated 
sentence. 

§5. Adjustments 

This section will examine the clean-up Adjustments, operations which further alter the 
Transformational Structure after all the transformations have been applied, in order to obtain the 
correct English output. We will start with an example. Consider the following kernel sentence 
K = "Ivan was eating potatoes." The 'Transformational Structure TS(K Q ) for the kernel K Q is 
shown in (13): 
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((CQMP comp) (NPj (Ivan)) 

(TENSU past) (INFL infl) (AUXl be) (NEG1 negl) (NEG2 neg2) (AFFIX! ing) (13) 

(AUX2 nil) (AFF1X2 nil) (AUX3 nil) (A1FIX3 nil) (VERB eat) 

(NP 2 (potatoes))) 

Suppose that the program GEN gels as input the following TASK: 

TASK = ( (K Q ) (/V7 Question) (.)) 

Fere, /V7 is the notation for the contracted form of the negative IransfprmaEon, H s'lmply inserts 
nl the contracted form of not, as the "alue of the element NEG1 of the TSiK^). Questio n is the 
name of the question transformation. This transformation takes the th,rej elements: TENSE, 
AUXl and NEG1 in the Transformational Structure of 3 kernel sentence and moves them to the 
front of the structure. 

TS*(K ), the altered Transformation Structure of TS(K Q ) after undergoing these two 
transformations, is shown below in (14): 

((TENSE past) (AUXl be) (NEG1 n't) (CQMP cpmp) (NP^ (Ivan)) 

(INFL inn) (NEG2 neg2) (AFF1X1 ing) (14) 

(AUX2 nil) (AFFIX2 nil) (AUX3 nil) (AFFIX3 nil) (VERB eat) 

(NP 2 (potatoes))) 

Now that all the transformations have been applied to TS(K Q ) let tis consider how certain 
Adjustments work: on the resulting Transformational Structure (14). 

(a) Garba ze Deletion removes 3! J the elements in the TS which have been Igft pspecified <*t this 
point, U also rejects all elements whose value is nil. The result is: 

((TENSE past) (AUXl be) (NEG1 n't) (NP t (Ivan)) 
(AFFIX! ing) (VERB pat) (NP 2 (potatoes))) 

(b) Da D eletion deletes tlie auxiliary do when it immediately precedes a verb- But the 
Transformational Structure is, designed in such a way that the auxiliary do is inserted in the TS as, a 
yalue of the AUXl only when the original kernel sentence does pot contain any other auxiliary 
verbs. There is no do in the Structure (14) since the auxiliary be is present, therefore the adjustment 
Pa Deletion is noj applicable in this example. 

(c) Affix Hoppins takes every affix that is immediately followed by a verb (mending TENSE, which 
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/^ ;h mentioned in Section 1 also carries the grammatical features of NP ) and attaches it to the verb so 

that the affix becomes part of it: 

((AUXl was) (NEG1 n't) (NP, (Ivan)) 
(VERB eating) (NP 2 (potatoes))) 

W) Ml tbmm takes the element NEC51 of the Transformational Structure and attaches its value 
nt to the immediately preceding auxiliary verb. 

((AUXl wasn't) (NP 1 (Ivan)) (15) 

(VERB eating) (NP 2 (potatoes))) 

Now that all the adjustments have beer performed, the word string composed of the values of all 

the constituents of the Transformational Structure (15) produces the correct kernel sentence 

* ■ 

K —"Wasn't Ivan eating potatoes": 

Thus, we have examined the following four Adjustments'} 1 

1. Garbage Deletion 

2. Do Deletion (16) 

3. Affix Hopping 

4. N't Hopping 

We are going to show now that in order to build a system of Commutative transformations the 
following two constraints must be imposed: 

S epara tion Constraint : Any adjustment in the list (16) should be executed only after all the 
transformations from the TASK have been applied. 

Ordering Constraint : The adjustments must be applied only in the order in which they are 
listed in (16). 

First, in order to prove the necessity of the Separation Constraint we need to show that none of the 
adjustments can be performed before a transformation. This can be shown by contradiction: we 
will demonstrate for each of the adjustments in (16) that the violation of the Separation Constraint 
prevents the application of certain transformations or leads to an infraction of comtnutativity. 



r\ 



r\ 



21. In the implemented system there are a few oilier adjustments, but. for simplicity we will not discuss them here. 
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Finding one counterexample to eveiy adjustment is sufficient for a proof because of the 
Commutalivity of the system. For clarity, we will consider the arguments in connection with either 
the kernel sentence "Ivan ate the carrot" and its corresponding Transformational Structure (17): 

((COMP comp) (NP 1 (Ivan)) 

(TENSE past) (INFL infl) (AUX1 do) (NEGl negl) (NEG2 neg2) (VERB 'eat)" (17) 

(NP 2 (the carrot))) 

or with the kernel sentence "Ivan was eating the carrot" and its Transformational Structure (18): 

((COMP comp) (Nl^ (Ivan)) 

(TENSE past) (INFL -inn) (AUX1 be) (NEG1 negl) (NEG2 neg2) (AFFIXl ing) (18) 

(VERB cat) 

(NP 2 (the carrot))) 

1. Garbage Deletion cannot be performed before any transformation that uses the dummy elements 
in the Transformational Structure; for instance, Negation, or any transformation that constructs 
embedded clauses. This is because the elements required by such transformations would be deleted 
by the Garbage Deletion adjustment before these transformations could have been applied, 

2. Do Deletion cannot be performed before the Question transformation, If it were, the auxiliary 
verb do which is necessary for the construction of the correct output of the Question transformation, 
"Did Ivan eat the carrot", will be prematurely deleted by the adjustment Do Deletion. 

3. Affix Hopping cannot be performed before any transformation that inserts a new verb or a new 
affix into the Transformational Structure. Suppose that the transformation Passive is to be applied 
to the Transformational Structure (18) of the kernel sentence "Ivan was eating the carrot" Among 
other effects this transformation inserts the verb bg with the affix gn in front of the main verb eat 
into the Transformational Structure (18) in order to obtain the past participle of the verb. 22 

((COMP comp) (NP 1 (The carrot)) 

(TENSE past) (INFL inn) (AUX1 be) (NEGl negl) (NEG2 neg2) (AFFIXl ing) 

(BEPASS be) (EN-PASS en) (VERB eat) 

(BY-PASS by) (NP 2 (Ivan))) 

If the adjustment Affix Hoppinghad been applied to the Transformational Structure (18) before the 



22. The description of the Passive transformation can be found in Section 7, 
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^""^ Passive transformation, the affix ing would "hop" onto the wrong verb eat instead of the verb be. 

The affix en, inserted afterwards by the Passive transformation, could not "hop" on the verb eat. As 
a result, the system would not be able to output the expected sentence "The carrot was being eaten 
by Ivan." 

4 The.' adjustment 7VV Hogging also cannot precede certain transformations. Let us consider the 
1 ransforma.tion.al Structure TS* for the sentence " I van ate the carrot" after the two transformations 
Question and N't have been applied: 

((TENSE past) (AUX1 do) (NF.G1 n't) (COMP comp) (NP 1 (Ivan)) 
(INFL infl) (NEG2 neg2) (VE ; *B eat) 
(Niy (the carrot))) 

If the adjustment N't Hogging is now applied before the transformation Passive, the element nt will 
be prematurely attached to the auxiliary verb do. As a result, it will be impossible to execute the 
transformation Passive and transform the sentence " Didn't Ivan eat the canot" into the sentence 
" Wasn't the carrot eaten by Ivan." 

^""^ We have shown that the adjustments are separated from the transformations. Now, to demonstrate 

that the Ordering Constraint is needed, we will again examine the sentence "Ivan ate the carrot" and 
its Transformational Structure (17). We need to show that the adjustments must necessarily be 
ordered as stated in (16): 1. Garbage Deletion, 2. Do Deletion, 3. Affix Hopping, 4. N't Hopping. 

1. Garbage Deletion differs from the other three adjustments in (16) because it does not employ the 
notion of adjacency required by all the other adjustments: Do Deletion deletes the auxiliary do 
when it immediately precedes a verb; Affix Hogging attaches the affix to the verb immediately to Us 
right; N't Hopping attaches n't to the immediately preceding auxiliary verb. 

Prior to the adjustment Garbage Deletion, the adjacency condition necessary for the application of 
the other adjustments does not hold because of the presence of unspecified elements in the 
Transformational Structure. Garbage Deletion should be executed first because it eliminates these 
unspecified elements allowing the other adjustments to work. For example, Garbage Deletion 
removes the unspecified elements NEG1 and NEG2 in the Trans formation al Structure shown 
below, making it possible for Do Deletion to delete the auxiliary do since do and the main verb are 
now adjacent: 
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.((NP,. Ovan)) 

(TENSE past) (AUX1 do) (VERB eat) 
(NP 2 (the carrot))) 

It should also be noted that the adjustments Do Deletion, Affix Hopping, and N't Hopping do not 
introduce any dummy or unspecified elements in the TS which would otherwise have to be 
removed by the Garbage Deletion. 

2. Do Deletion must be performed before Affix Hopping. Otherwise, the value past of the TENSE 
would "hop" onto the verb do instead of eat, and after executing all the adjustments on the 
Transformational Structure (17) we would obtain the sentence "Ivan did eat vhe carrot" instead of 
"Ivan ate the carrot." 23 

3. The adjustment Affix Hopping cannot follow N't Hopping. To show this suppose that the 
transformation N't has been applied to the Transformational Structure (17). After the Garbage 
Deletion adjustment the TS will have the following form: 

■■((NP l (Ivan)) 
(TENSE past) (AUX1 do) (NEG1 n't) (VERB eat) 
(NP 2 (the carrot))) 

If now the adjustment 7VV Hopping is executed first, producing the new element don't, the Affix 
Hopping adjustment will not be able to attach the TENSE to the element, don't. Tins observation 
completes the proof of the Ordering Constraint. 

Thus two different classes of operations on the Transformational Structure have been defined in 
this paper so far: the optional commutative Transformations and the obligatory, intrinsically 
ordered Adjustments. The Separation Constraint and the Ordering Constraint explain their mutual 
relations. 

§6. Connective Transformations 

In this section we will examine the Connecti ve Transformations , a particular class of English 
transformations which are used to construct sentences with Embedded Clauses. In order to form a 



23. The sentence "Fyan did eat the carrot" is, of course, fully grammatical It is the emphatic form of the sentence "Ivan 
ate the carrot" used to stress a certain semantic message. In designing the system we decided jiot to allow such sentences 
so that all the adjustments would be obligatory. 



;<atz 



- 20 - Connective Transformations 



f**\. sentence of this type the system needs two kernel phrase markers as input: K Q - which plays the role 

of matrix clause and K - which is used as the basis for the embedded clause. The word it will be 
used as a joining point. The kernel sentence K must contain the word //, in the role of either agent 
or theme. A Connective Transformation when applied to the kernel sentence K { is said to produce 
the altered kernel K* in the form appropriate for an embedded clause. Other transformations 
(if any) change the kernel K y into K*. Then, a special procedure combines the two altered kernel 
sentences by substituting the kernel K , for the joining point U in the kernel K } . 

As an example of the procedure just de cribed, consider the following kernel sentences: 

K Q ■= It bothers Maria ^ 

K : - Ivan has ignored that letter 

The embedded clause K t has the Transformational Structure below: 

((COMP comp) (NP ] (Ivan)) 

(TBNSF present) (INFI. infl) (AUX1 have) (NF.GI ncgl) (NI-G2 ncg2) (AFF1X1 en) (20) 
^ (VERB ignore) (NP 2 (that letter))) 

Now suppose that one of the Connective Transformations, FOR-NP^TO,, is to be applied. This 
transformation produces a/or-to-complemcnt clause by inserting FOR and TO as the values of the 
elements COMP and INFL, respectively, in the Transformational Structure (20). The result is: 

((COMP For) (NPj (Ivan)) 

(TENSE present) (INFL to) (AUXl have) (NKG1 ncgl) (NFG2 neg2) (AFFIX1 en) 

(VERB ignore) (NP 2 (that letter))) 

Then the transformed kernel sentence K* = "For Ivan to have ignored that letter" is substituted 
for the word it in the kernel K Q = "It bothers Maria" producing the sentence: "For Ivan to have 
ignored that letter bothers Maria" as the result 

The Connective Transformations form a family of transformations defined by three parameters, 
each referring to a position in the Transformational Structure of the embedded clause: the 
complementizer COMP, the first noun phrase NI\ and the complementizer INFL. 

-^ The parameter COMP indicates the affix which introduces the embedded clause. It can receive one 

' of the following four values: {POSS, THAT, FOR, 0}. The affix POSS actually "hops" onto the 

following noun during the Affix Hopping adjustment to form a possessive noun phrase. THAT and 



Kalz -21- Connective 1 ransibrnuitions 

FOR are "independent" words and do not hop to the right like other affixes. means that there is 
no overt affix in this position. 

Mie parameter NP takes on one of two values: {NP r 0} indicating whether or not the first noun 
phrase of the embedded clause is present in the resulting sentence. 

r lie parameter INFL may also be considered an affix specifying how the verb in the embedded 
clause should be inflected, It can have one of four values: {ING, INF, TO, 0}. As in the case of 
POSS, the value ING is the only "real" affix which hops onto the following verb producing the 
progressive form. The value INF indicates that the following verb is in the infinitive form, TO is 
c.n independent word which produces Tie TO + infinitive form of the verb. signals that no affix 
is present, so the verb remains inflected for person, number and tense. 

A particular set of values for the three parameters COMP, NP r and INFL is sufficient to determine 
tne form of the embedded clause completely (although not every possible triple produces a 
grammatical English clause). Hence the commutative transformation which generates the 
embedded clause is also uniquely determined, Therefore, we will use the values of these three 
parameters to form the names tor the Connective Transformations. Each name is represented as a 
triple consisting of the current values of the parameters COMP, NP l and INFL with the following 
structure:.. COM P-NP -INFL, We have already seen some examples of such names; -Q-NP^TO, 
THAT-NP^O, FOR-NPj-TO, etc. 

The adjustment Affix Hopping deletes the element TENSE in the Transformational Structure 
unless the value of the parameter INFL is 0, Consequently, most of the Connective 
Transformations construct tenseless clauses. The exceptions are the transformations THAT-NP^O 
and. Q-NP -0. To give examples with tensed embedded clauses let us consider now another kernel 
sentence for the matrix clause: K Q = "Maria knows it," After combining the altered kernels, the 
program outputs the following sentences; 

1. After THAT-NP^O : Maria knows that Ivan has ignored that letter 

2. AfterO-NP -0^ Maria knows Ivan has ignored that letter 

The transformations THAT-NP^O and 0-NP^O also differ from the transformations which 
produce tenseless clauses in their treatment of negative elements in the Transformational Structure. 

A general description of the action of a Connective Transformation can be stated as follows; 

(a) Current values of the parameters COMP and INFL from the name of the transformation 
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/^ are inserted in the Transformational Structure. 

(b) If the value of ihe parameter NP is 0, the element NP } is removed from the Structure. 

(c) If the value of INFL is not 5 two negative elements, NEG1 and NEG2, are moved from 
their usual position after the firs! auxiliary vcib and placed in the front of TENSE. We will 
call this phenomenon NegJump. 

When the value of the parameter NP is 0. the first noun phrase in the matrix clause must be 
preferential with the first noun phrase in the embedded clause. As an example, consider the pair 
of kernel sentences: 

K — Ivan wanted it 
K = Ivan kissed Maria 

Suppose that the transformation 0-0-TO applies. This transformation inserts the required values of 
COMP and INFL into the Transformational Structure for the kernel sentence K x and deletes the 
clement NP in the Structure: 

((COMP 0) (NP t 0) (NEG1 negl) (NEG2 neg2) 
,/^N (TENSE past) (INFL to) (AUX1 do) 

(VERB kiss) (NP 2 (Maria))) 

After all the adjustments have been performed and the altered kernels have been combined the 
program will output: "Ivan wanted to kiss Maria.' 1 

In the example above Neg Jump takes place only vacuously because the unspecified elements 
NEG1 and NEG2 are removed from the Transformational Structure. It is also difficult to see this 
phenomenon if the kernel sentence . K does not have any auxiliary verbs because after the Garbage 
Deletion adjustment nothing will be left in the TS for NEG to jump over. This phenomenon can be 
observed in a sentence in which the negative transformation Not also applies. The following TASK 
provides us with the appropriate examples: 

TASK = ((K K x ) {That'np { l Not x For-np { to x Poss-np^ing) (.)) 

Here K Q and K x are the kernel sentences from (19): 

K Q = It bothers Maria (19) 

/■""■N K = Ivan has ignored that letter 

NegJump can be observed by comparing either sentences #2 with #3 or sentences #2 with #4 
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in (21): 

1. After IHAf -NP -Oji That Ivan has ignored that letter bothers Mafia 

2. After NOT : That Ivan has not ignored that letter bothers Mat fa (21) 

3. After i : OR-NP - 'TO : For Ivan not to have ignored that teller bothers Maria 

4. After FOSS-Niy 1 NG : Ivan's not haying ignored that letter bothers Maria. 

The system contains a family of ten different Connective Transformations used to construct 
sentences with various embedded clauses. An example of die application of each of these 
transformations is given in the table below: 

TABLE! 



Transformation Matrix Clause Embedded Clause 



THAT-NP^O 
THAT-NiyiNl 7 
0-NlytNF 
Q-NiyO 

FOR-Niyro 

0-NPj-TO 

o-oto 

POSS-NPj-ING 

0-NfyiNG 
0-0-ING 



It bothers Maria 
Maria suggests it 
Maria Watched it 
Mafia knows it 
It amuses Marici 
Maria asked it 
Ivan claims it 
It shocked Maria' 
Maria saw it 
It amuses Maria 



Ivan ignored the letter 

I vafl is silent 

Ivan washed the dishes 

Ivan has ignored that letted 

Ivan ignored the letter 

Ivan ate the cake 

Ivan has written that letter 

Ivan ignored the letter 

Ivan ate the cake 

Mafia watches movies 



Sentence 

That Ivan ignored the letter bothers Maria 
Maria suggests that Ivan be silent 
Maria watched Ivan wash the dishes 
Maria knows Ivan has ignored that letter 
For Ivan to ignore the letter amuses Maria 
Maria asked Ivan to eat the cake 
Ivan claims to have written that letter 
Ivan's ignoring the letter shocked Maria 
Mafia saw Ivan eating the cake 
Watching movies amuses Maria 



The main verb of the matrix clause determines which clause ffiay be embedded under it and, 
therefore, the kind of Connective Transformation that may be applied in each particular case. 
Consequently, any computer implementation of the Language Generation Procedure must contain 
a list of permissible transformations for every verb that can appear in & matrix clause. 

The system prevents the generation of the ill-formed sentences by employing transformational 
filters, a third class of operations on the Transformational Structure, which not only signal that a 
certain combination of the transformations will result in an urtgrattlltiatical sentence, but also, if 
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^""^ possible, suggest additional rules in order to correct the output." Although this paper will not 

consider such rules in detail, here are several illustrative examples: 

(a) If the transformations THAT-NPj-0, and PASSIVE have been applied to kernel sentences K 
and K from (19). the resulting sentence obtained after combining the altered kernels is ill-formed: 
* "Maria is bothered by that ban has ignored that letter." The transformational filter rejects the 
i ngrammatical construction prep-T HAT- clause and suggests that the words "the fact" be inserted 
h the Transformational Structure of the embedded clause. Then, after all the Adjustments have 
been applied, the system outputs the correct sentence: "Maria is bothered by the fact that Ivan has 
ignored that letter." 25 

(b) If the transformations 0-NP-TOj and PASSIVE are to be performed on the kernels K Q = 
"Maria forced it" and K = "Ivan peeled potatoes", the program has to combine the altered kernel 
I-:* = "It was forced by Maria" with the altered kernel K* = "Ivan to peel potatoes." The 
transformational filter rejects the resulting sentence: * "Ivan to peel potatoes was forced by Maria" 
as ungrammatical. Then, taking into account the semantic class of the main yerb force, the filter 
proposes to "raise" the first noun phrase of the embedded clause hem to the position of the first 

f^. noun phrase in the matrix clause it\ the rest of the embedded clause moves to the end of the matrix 

clause. Now the resulting sentence is correct: "Ivan was forced by Maria to peel potatoes." 

(c) If the embedded clause is very long, the transformational filter suggests applying the 
Extraposition rule, a rule which shifts the embedded clause to the end of the matrix clause leaving 
the word "it" in its original position in the matrix clause. Thus, the sentence #1 from (21) can be 
changed to "It bothers Maria that Ivan has ignored that letter." 26 

A family of ten transformations for generating embedded clauses was introduced in this section. 
This family is completely defined by the values of three parameters COMP, NP r and INFL and, 
therefore, can be considered as a single Connective Transformation whose surface manifestation has 
several different forms depending on the values of these parameters. 



24. In contrast with the usual transformations, which operate within a kerne! sentence, one can analyze transformational 
filters as interkemel transformations because they may operate across the kernels. 
/•""""N 25. The noun "fact" is one of the so-called/urt/w.- nouns which include also words like "idea", "report", etc. 

26. We leave aside for now the question of denning "length". Notice, that the Extraposition rule may also apply to short 
embedded clauses: "It bothers Maria that Ivan left." 
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§7. Other Transformations 

in this section we will add three new transformations to the system of Commutative 
Transformations: T = Passive, T [m = Dative Movement, and T n = There Insertion, The 
clefiniUoiis of these transformations refer to the noun phrase positions in the Transformational 
Structure: NP , NP , NP r and to their <e\ical and semantic values. 

De finition: 

Passive is a transformation that 

(a) Permutes to the left the values of three noun phrases NP r . NP 5 , and NP 2 

t V 

NP _<_-_- j^p <„,™, W NP ? 

(b) Inserts the verb be after the affix of the last auxiliary verb or, if AUX1 = do, substitutes 
the verb hs. for the auxiliary do 

(c) Inserts the affix en in front of the mate vert? 

(d) Inserts the preposition by in front of NP^ 27 

Consider the kerne! sentence K = "(van gave Maria the bottle" with the Transformational 
Structure (22): 

((CQMP comp) (NP ; (Ivan)) 

(TENSE past) (1NFL infl) (AUX1 do) (NEC1 negl) (NEG2 neg2) (22) 

(VERB give) (NP (Maria)) (NP 2 (the bottle))) 

The Passive transformation alters the kernel sentence K = "Ivan gave Mam the bottle' 1 info the 
sentence T(K) « "Maria was given the bottle by Ivan" by changing the Transfomiational 
Structure (22) into; 

((COMP comp) (NPj (Maria)) 

(TENSE past) (INFL infl) (AUX1 fee) (NEC1 negl) (NEG2 neg2) (23) 

(EN-PASS en) (VERB give) (NP (the bottle)) (BY-PASS by) (NP 2 (Ivan))) 



27. In this definUion, when referring to the words be, en, and byw wean elements (BE-PASS be), (EN-PASS en), and 
(BY-PASS by) in the Transformational Structure. 
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In ihc case when there are only two noun phrases in the input kernel sentence, to permute two 
NP's means the same as to interchange them. In this case our definition comes closer to the 
conventional definition of Passive. 

Hie transformation Dative Movement changes the kernel sentence K = "Ivan gave Maria the 
bottle" into the sentence T (K) = "Ivan gave the bottle to Maria." A possibl ; definition of Dative 
Movement could refer to the syntactic constituents NP ]5 and Nl> 2 in tie Transformational 
Structure: 

(a) Interchange the values of NP ]5 and NP 2 

(b) Insert the word to in front of NP 2 

.1 his .definition of Dative Movement when applied to the kernel K gives the dt sired result T 2 (K) = 
"Ivan gave the bottle to Maria." Suppose, however, that the Passive transformation is to be applied 
to the kernel K prior to Dative Mo vement producing the Transformational Structure (23) 
corresponding to the sentence T p (K) = "Maria was given the bottle by Ivan." If Dative Movement 
(as it is defined above) is now applied to T p (K), the Transformational Structure will be transformed 
into: 

..((CO M P comp) (NP, (Maria)) 
(TENSE past) (1N-FL infi) (AUX1 be) (NEG1 negl) (NEG2 neg2) 
(EN-PASS en) (VERB give) (NP [5 (Ivan)) (BY-PASS by) (DAT to) (NP 2 (the bottle))) 

The resulting sentence T DM (T p (K)) is unacceptable: * "Maria was given Ivan by to the bottle." 

In order to obtain the correct result we need a different definition of Dative Movement which refers 
not to NP-positions in the Transformational Structure, but rather to semantic values of the noun 
phrases which indicate the role that the noun phrase plays in the sentence: agent, goal, or theme. 

In this paper several transformations which operate on the Transformational Structure of a kernel 
phrase marker have been examined: the Question Transformation, Negation (full and contracted), 
Passive, and the Connective Transformation. All of these transformations are defined in purely 
syntactical terms: they move, insert, or delete syntactic constituents in the Transformational 
Structure. So far, we have seen semantic notions used only in the "decision-making" procedures. 
For instance, the system needs the semantic class of the main verb in the matrix clause to determine 
which of the Connective Transformations may be applied and what rule should combine the altered 
kernel sentences. 
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Dative Movement is the only transformation in our system- that is clef incd in semantical terms. 

Definition: 

Dative Movement is a transformation that 

(a) Interchanges the noun phrase which plays the role of goal with the noun.- phrase which 
plays the role of theme 

(b) Depending on the main verb, assigns one of two values {TO, FOR} to the element DAT 
which wiil later be inserted in front of the goal noun phrase in the TS b) a special adjustment 
DAT Insertion 

The result of this transformation is that the goal noun phrase will be in th-j position previously 
occupied by theme noun phrase and the theme NP will be in the position occupied by goal NP. 

For instance; the Dative Movement transforms the Transformational Structure (22) of the kernel 
sentence K = "Ivan gave Maria the bottle" into: 

((COMP comp) (NPj (Ivan)) 

(TENSE past) (!NFL toft) (AUX1 do) (NBGl negl) (NBC2 neg2) (24) 

(VERB give) (NP ]5 (the bottle)). (NP 2 (Maria))) 

Then the adjustment DAT Insertion inserts the element (DAT to) into the Transformational 
Structure (24) resulting in (25): 

((COMP comp) (NP 1 (Ivan)) 

(TENSE past) (fNFL infl) (AUX1 do) (NEGl negl) (NEG2 neg2) (25) 

(VERB give) (NP i5 (the bottle)) (DAT to) (NP 2 (Maria))) 

After all the other adjustments have been performed the system outputs the correct sentence "Ivan 
gave the bottle to Maria." 28 

Not only do we obtain the correct results by applying each of two transformations Passive and 
Dative Movement to the TS of the kernel sentence, but also, our definitions are so formulated that 
these transformations can be applied in any order. Dative Movement can be applied to the 
Transformational Structure altered by Passive and vice versa. 



28. In the usual analysis (see, for instance JAkmajian and Heny 1975]) Dative Movement transforms the sentence "Ivan 
gave die bottle to Maria" into "the sentence "Ivan gave Maria the bottle/' 
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I el us. for example, apply Dative Movement to the TS it) (23) altered by the Passive transformation. 
The noun phrase "Maria" which plays the role of goalte interchanged with the noun phrase "the 
bottle" which plays the role of theme. Then, the DAT Insertion adjustment inserts the preposition 
to in front of the goal noun phrase "Matia" producing the TS (26): 

((COMP comp) (NP, (the bottle.) 

(TENSE past) (INFL infl) (AUXl be) (NEG1 ncgl) (NEG2 neg2) (26) 

(EN-PASS en) (VERB give) (DAT to) (NP 15 (Maria)) (BY-PASS by) (NP 2 (Ivan))) 



Trie resulting sentence is T nv (T (K)) '= "The bottle was given to Maria by Ivan.' 



The 



■T -ansformational Structure (26) can also be obtained if the transformation Passive is applied to the 
TS (24) (that is, after Dative Movement has been applied). 

The following diagram (27) illustrates th? commutativity of these transformations: 



r^ 



Dative Movement 



K = Ivan gave Maria the bottle 



-> 



DM 



(K) = Ivan gave the bottle to Maria 



Passive 



Passive 



(27) 



4, Dative Movement v 

T (K) =•. Maria was given the bottle by Ivan — — > The bottle was given to Maria by Ivan 



The final transformation to be considered is There Insertion, defined below. 



Definition: 



There Insertion is a transformation that 



(a) Substitutes the word there*' 9 for the the Imposition in the TS 
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29. More precisely, the element (111 there) of the Transformational Structure. 
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(b) Moves the NP -position in front of the affix associaied with the leftmost occurrence of the 
verb bg in the Transformational Structure 

As an example, consider the kernel sentence K - "A boy was eating a cake" with the 
Transformational Structure (28): 

((COMP comp) (NP, (a boy)) 

(TENSE past) (INFL infi) (AUX1 be) (NEGl ncgl) (NEG2 neg2) (AFFIX! ing) (28) 

(VERB eat) (NP 2 (a cake))) 

There is only one verb be in the TS above, therefore, AFFIX1 is the required affix. After applying 
the transformation There Insertion the Transformational Structure (28) will be transformed to (29): 

((COMP comp) (Til there) 

(TENSE past) (INFL infi) (AUX1 be) (NEGl negl) (NEG2 neg2) (29) 

.(NP, (a boy)) (AFFIX1 ing) (VERB cat) (NP 2 (a cake))) 

The corresponding English output is "There was a boy eating a cake." 

Suppose, however, that Passive was applied to the Transformational Structure (28) causing another 
verb be to be inserted after AFFIXl: 

((COMP comp) (NP, (a cake)) 

(TENSE past) (INFL infi) (AUX1 be) (NEGl negl) (NEG2 neg2) (AFFIX! ing) (30) 

(BE-PASS be) (EN-PASS en) (VERB eat) (BY-PASS by) (NP 3 (a boy))) 

Mere the leftmost occurrence of be in the Structure (30) Is the one referred to in the definition of the 
transformation There Insertion and the position of the first noun phrase is moved in front of its 
affix: 

((COMP comp) (TH there) (TENSE past) (INFL infi) 

(AUX1 be) (NEGl negl) (NEG2 neg2) (NP, (acake)) (AFFIXl ing) (31) 

(BE-PASS be) (EN-PASS en) (VERB eat) (BY-PASS by) (NP 2 (a boy))) 

The Transformational Structure (31) produces the sentence: "There was a cake being eaten by a 
boy." 

Consider now the question of the commutativity of the three transformations introduced in this 
section. It follows from the definitions that There Insertion does not change the original disposition 
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/**% cl* the noun phrases N'P r NPj , and NP ? in the Transformational Structure. Therefore, since There 

Insertion does not interfere with the action of Passive and Dative Movement, it does not prevent 
these transformations from permuting or interchanging the noun phrases. It is thus possible to 
apply the Passive transformation and Dative Movement after There Insertion. On the other hand, 
Dative Movement and Passive may freely interchange the noun phrases in the TS because it makes 
no difference to the transformation There Insertion which of the noun phrases is located in the 
MP -position. 30 There Insertion, therefore, can be applied after Passive and Dative Movement 
Since we have shown that There Insertion may precede or follow Passive and Dative Movement, and 
that the transformations Passive and Dative Movement are commutative, it follows that all three 
transformations introduced in this sectii >n are commutative. 

1 he application of There Insertion is restricted to sentences with an indefinite noun phrase in the 
NP position, but the transformations Passive and Dative Movement interchange the noun phrases 
iii the Transformational Structure. We, therefore, need a sentence with three indefinite noun 
phrases to provide an appropriate example for showing the commutativity of the transformations. 
In this case the result of application ofThere Insertion would be grammatical regardless of the order 
of the transformations. Suppose that K = "A man was reading a boy some interesting stories. M If 
the three transformations are applied in the order: 1. There Insertion, 1 Passive, 3. Dative 
Movement, the result is: 

1. After There Insertion: There was a man reading a boy some interesting stories. 

2. After Passive: There was a boy being read some interesting stories by a man. 

3. After Dative Movement: There were some interesting stories being read to a boy by a man. 

The reverse order of the transformations: 1. Dative Movement, 2. Passive, 3. There Insertion 
produces the following sentences: 

1. After Dative Movement: A man was reading some interesting stories to a boy. 

2. After Passive: Some interesting stories were being read to a boy by a man. 

31 

3. After There Insertion: There were some interesting stories being read to a boy by a man. 



/^ 



/"""\ 30. There Insertion merely moves the NPj-position in the Transformational Structure to the right. 

31. We will not give here examples of all possible permutations of these transformations because the commutativity of 
Passive and Dative Movement has been already shown before. 
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This section has introduced three additional transformations that refer to noun phrase positions and 
their values. 32 The Passive transformation refers to the positions NP r NP . and NP 2 permuting 
their values. Dative Movement refers to the semantic values goal and theme and interchanges the 
corresponding NP-positions. There Insertion moves the NP^position in the Transformational 
Structure. 

Step Three of the Language Genera! ion Procedure uses the constructed system of optional 
commutative 7 transformations, the set o' conditionally obligatory Transformational Filters, and the 
set of ordered obligatory Adjustments to "solve" the TASK provided by Step One and Step Two 
ar d to produce the corresponding English text 



32. TTie system contains other transformations, such as the Relative transformation, Imperative and Tag Question, but 
they will not be discussed here. 



katz 
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/"> APPFNDIX1: Pronominalization 

The program GEN which implements Step Three of the Language Generation Procedure "reads" 
the input TASK supplied by Step One and Step Two of the LGP and generates the appropriate 
word string. Each element of the TASK consists of a list of kernel phr;;se markers, a list of 
transformations, and a syntactic separator. There is a one-to-one correspondence between each 
TASK element and each English sentence in the output. Every noun phrase in a generated 
sentence derives its lexical value from one of the prepositionless noun frames, NF agt ' m , NF goal , or 
NF ,1,,m ', f the Semantic Frame Structure. Transformations may interchange the values of noun 
phrases, but the actual word string i; never altered; it can only be transferred into another 
NP-position in the Transformational Stiucture. Therefore, if different phrase markers of the TASK 
refer to the same noun frame, each instance of the corresponding noun phrase would have the same 
lexical value. 

This repetition is awkward and in order to make the text more fluent, the system requires a 
pronominalization procedure which substitutes the repeated noun phrase with an appropriate 
pronoun. The choice of the pronoun is determined by two parameters, the number and gender of 
f~\ the corresponding noun phrase. The values of these two parameters can be computed from the 

number and gender of the nouns whicn are heads of the noun phrases and the conjunctions that 
connect them. 33 

The pronominalization procedure is activated every time the system "reads" the next element of the 
TASK and generates the corresponding English sentence. In order to decide which noun phrase 
should be pronominalized, two subsequent sentences, referred to by the names current and 
previous, are examined. 

Definitions. 
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Currcnt-NP-list is a list of all noun phrases in the last generated (current) sentence. 

Previous- NP-lisl is a list of noun phrases in the previous sentence. 

Previous-pronouns- list (PPI .) is a list of pronouns corresponding to each clement of the previous- NP-lisl. 



34 



33 In this paper we will not describe the rules that the system uses to calculate the number and gender of a given noun 
phrase For instance, the number of the noun phrase "Ivan and Maria" is "plural", the gender is indi lerenh Or, in Uie 
case of another noun phrase, "the man with a red tie", the number is "singular", the gender is masculine . Similar rules 
can be found in [Katz 1978]. 

34 All the pronouns contained in the previous- pronouns-list are in the nominative case. Bui after the decision to 
pronominaii/e a noun phrase has been made, the appropriate lexical form of a pronoun (nominative, objective, or 
possessive) is chosen depending on the case of the corresponding noun phrase. 
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Suppose, for example, that the following two senlcnces were generated by the system: 

"Maria suspects that Tania is writing a letter to Ivan; Tan ia loves Ivan." (32) 

m this example we have: 

current-NP-list = ((Tania) (Ivan)) 

previous- NP- list = ( (Maria) (Tania) (a letter) (Ivan) ) 

previous- pronouns- list = ( (she) (she) (it) (he) ) 

I- very noun phrase in the current-NP-list which is also present in m previous- NP- list \s a possible 
candidate for pronominalization. But the decision to pronominalize each noun phrase is made only 
j.fter comparing the pronoun that corresponds to the noun phrase under consideration with all the 
other elements of the PPL. 

Pronominalization Pule: A repetitive noun phrase in the current sentence is replaced by its 
pronoun only if the pronoun is unique in the previous-pronouns-lisi (that is, no other noun 
phrases in tlie previous sentence has the same pronoun). 

in the example (32) the prograrii will not ! substitute the pronoun "she" for the noun plirase "Tania" 
because this pronoun is not unique in the PPL. The Pronominalization Rule helps the system avoid 
ambiguity that arises when this substitution is made: "Maria suspects that Tania is writing a letter to 
Ivan. She loves Ivan." 

On the other hand, since there is only one occurrence of "he" in the PPL, the noun phrase "fvan" 
can be pronortiinafized, resulting in: "Maria suspects that tania is writing a letter to Ivan. Tania 
lOVeS hirn:" 35 

The PrdnoMHatizaiion Rule, however, is a necessary but not' a Sufficient c6hdition for the 
prohohiirialrzatibn procedure. In some cases complementary heuristic rules mUSt fe'emplbyed' in 
order to'niake the final" decision. 



35. II should 6e noted' that' move than one pronoun is possible in a sentence as long as the Pronohiinalizdtion kule is not 
violated: The example is: "Many people suspect that Tania is writing a letter to Ivan. She loves him-" 
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f*S APPENDIX 2: The Parser 

This section describes the parser, a program that processes kernel sentences and builds the 
corresponding Semantic Frame Structures using the three types of templates defined in Section 1 of 
this paper: 

noun-template (NT) = (prep cbt adj noun) 

verb-template (VT) = (tense aud aux2 aux3 verb) (34) 

adverb-template (AT) = (mod adverb) 

Each word in the kerne! sentence is always associated with a unique part of speech, 36 and, therefore, 
with a unique position inside one of the templates NT, VT, or AT. We will assume that a kernel 
sentence can be represented by the folic wing sequence of frames: 37 

jsjpinitial jsjpagcnt yp [sjpgoal jyjptheme j^jpfinal Q$) 

Each constituent in (35) can be obtained by applying the two operations Concatenation (CONC) 
^S c nd Conjunction (CONJ) 38 to the templates NT, VT, or AT in (34). All constituents are optional; 

for example, the presence of the frames NF gonl and NF thcmc depends on the type of main verb in 
the kernel sentence (transitive, intransitive, or double-transitive). ! 

The parser analyses every word in the input kernel sentence, scanning it from left to right and 
mapping the appropriate pieces of the word string onto the corresponding templates. The parser 
then decides which of the templates should be concatenated or conjoined in order to form the 
necessary noun-frame, verb-frame, or adverb- frame. Because each word in the sentence is 
associated with a unique template, the parser starts to create the appropriate type of template 
("opens" the template) after examining the very first v/ord in the sentence. The template must be 
filled out from left to right. If any element in the template is left unspecified, the parser inserts nil 
as the value of this element. When all the elements of the template are filled out, the parser 
"closes" the template. Then, depending on the next word and its position in the sentence, the 
parser has two choices: 



f~\ 



36. The question of lexical ambiguity, that is the case when one word can serve as various parts of speech, is not discussed 
in this paper. 

37. For simplicity, the adverb frames AF inilial , AF mcdy , and AF final are not shown here. 

38. These operations are defined in Section 1. 
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(a) it either continues the construction of the frame, starting to create another instance of a 
template of the same type, or 

(b) it "closes" the current frame and begins to fill out the elements of another template, 
thereby starting a new frame. 

Here is an example to clarify the procedure. Suppose that the parser lakes the following sentence as 
input: 

"In the evening a young tall man with blue eyes gave Maria a beautiful book and a rose." (36) 

triggered by the preposition "in", the parser begins the construction of the noun-frame NF mmal by 
filling out the noun-template as follows, ((prep in) (det the) (adj nil) (noun evening)). The next 
word in the sentence is the determiner "a", which indicates the absence of a preposition in the next 
noun-template, and, therefore, suggests that the frame (NF initial ((prep in) (det the) (adj nil) 
(noun evening))) should be closed and that the construction of a new prepositionless noun-frame 
NpBf«'' should begin. This frame consists of the concatenation of two noun-templates: 

(NF agem ((prep nil) (det a) (adj (young tall)) (noun man) 
(prep with) (det nil) (idj blue) (noun eyes))) 

There is no auxiliary verbs in the sentence (36), and hence the parser builds from the verb "gave" 
the following verb-frame (VF ((tense past) (auxi nil) (aux2 nil) (aux3 nil) (verb give))) with 
the unspecified auxiliary elements. Then, the word "Maria" forms another noun-frame (NF 80al 
((prep nil) (det nil) (adj nil) (noun Maria))). Finally, the parser uses the operation Conjunction 
to construct the last prepositionless noun-frame NF theme from two noun-templates: 

(NF lhcme ((prep nil) (det a) (adj beautiful) (noun book) (conj and) 
(prep nil) (det a) (adj nil) (noun rose))) 

The Semantic Frame Structure (37) below is the output of the parser after processing the 
sentence (36): 
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f\ ((NF" 1 " i, '((prep in) (dct the) (adj nil) (noun evening))) 

■('Npscnt (( prep n jj) ( ( j el a ) ( a( jj (young tall)) (noun man) 
(prep with) (det nil) (adj blue) (noun eyes))) 

(VF ((tense past) (auxl nil) (aux2 nil) (aux3 nil) (verb give))) (37) 

(NF 80;a ((prep nil) (det nil) (adj nil) (noun Maria))) 

(NF ,,emc ((prep nil) (det a) (adj beautiful) (noun book) (conj and) 
(prep nil) (det a) (adj nil) (noun rose)))) 

Let us consider now the problem of closure that arises in two different contexts in the parsing 
process: the closure of a template and the closure of a frame. 

A template is closed, after a certain word if: 

(a) The next word belongs to a template of another type. 

(b) The next word belongs to the same type of template, but corresponds to a template 
f"*^ element located to the left of the template element filled hist. 39 

Suppose now that a template has just been closed. The closure of a template implies the closure of 
a frame if: 

(a) The next word belongs to a template of another type. (The parser will then start to create 
a frame of the new type). 

(b) The next word is an element of a noun-template 40 but it is not a preposition. (The parser 
starts to construct a new prepositionless noun-frame). 

If these conditions are not satisfied, the parser continues the construction of the corresponding 
frame using, depending on the next word, one of the operations Concatenation or Conjunction. 
The rules above allow the parser to open and close all the frames in the kernel phrase marker (35), 
except the last one, NF n,,al . The system does not have a syntactic rule which can determine, when 
the prepositionless noun-frame NF ,htmo ends and NF final begins. What, for example, should 
happen in the sentence: "Ivan saw Maria with the binoculars"? One possible reading of this 
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39. Remember that a template must be filled out from left to right. 

40. We assume here that the previous template was aJso a noun-template; otherwise, the condition a. holds. 



FCatz; 



37- The Parser 



sentence, where the parser closes the frame NF ,h, " ,( ' and opens NF n -' as soon as the preposition 
with has been encountered, is represented below in the Semantic Frame Structure (38). It suggests 
that I van was watching Maria- through his binoculars: 

((MF* 61 " ((prep nil) (det nil) (adj nil) (noun Ivan))) 

(VF ((tense past) (auxl nil) (aux2 nil) (aux3 nil) (verb see))) 

(38) 

(NF th ' mc ((prep nil) (det nil) (adj nil) (noun Maria))) 

(NF nnal ((p,-ep with) (det the) (adj nil) (noun binoculars)))) 

Another reading of the sentence "Ivan saw Maria with the binoculars" is represented by the 
Semantic Frame Structure (39). In this case the parser uses the operation Concatenation to 
continue the construction of the noun-frame NF ,hemc after finding the preposition with. This 
reading suggests that Maria had the binoculars at the time when Ivan saw her: 

(( NF agem (( prep ni ]) ( det ni |) (adj nil) (noun Ivan))) 

(VF ((tense past) (auxl nil) (aux2 nil) (aux3 nil) (verb see))) (39) 

(NF thcmc ((prep n jf) (det nil) (adj nil) (noun Maria) 

(prep with) (det the) (adj nil) (noun binoculars)))) 

The problem of attaching the last prepositional phrase (PP final Attachment) requires the use of 
semantic/syntactic interaction for its resolution [Marcus 1979] and will not be discussed here. 41 

The parser described here is restricted to processing the kernel sentences of the general form (35). 
However, more complicated sentences with several clauses can also be analyzed by the parser if a 
mechanism that splits the sentence into kernels is provided. As an example, consider the sentences 
with embedded clauses generated by the Language Generation Procedure with the help of the 
Connective Transformations (see Table 1 in Section 6). The use of simple heuristic procedures (for 
example, counting the number of verbs and noun phrases, or searching for certain values of the 
complementizers COMP and INFL) appears to be sufficient for reconstructing the kernels (matrix 
clause and embedded clause) which form every complex sentence in Table 1. For instance, the 



41 . At this point, the parser makes the decision based on a list of prepositions which "usually" begin a new rtoun-frame 
(i.e. through). 
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/"""\. scnlcnce "Ivan claims to have written that letter" consists of two clauses: "Ivan claims it" and "Ivan 

has written that letter", which have been combined by the transformation 0-OTO. The possibility 
to reconstruct the kernels allows the parser to process any sentence generated by the Connective 
Transformations. 

Suppose that the input to the parser consists of several connected sentences ;a coherent text), and 
that a pronominalization procedure had been employed by the writer in older to make the text 
more fluent. If this procedure had been accomplished obeying the Pronominalization Rule stated in 
Appendix 1, the parser can easily resolve the anaphor, i.e. restore the noun phrases which were 
replaced by the pronouns. 

This parser has been used as a front end for Winston's learning system [Winston 1980]. It translates 
English descriptions of situations into descriptions in the extensible- relation representation. This 
representation was suggested by Winston and is implemented in his learning system using a version 
of Frame Representation Language [Roberts and Goldstein 1977]. In FRL, an agent- act- theme 
combination is expressed as a frame, a slot in the frame, and a value in the slot. In the 
extensible-relation representation, a supplementary description node for an agent-act-theme 
/-s. combination is expressed as a comment frame attached to the frame-slot- value combination. 

Suppose, for example, that the following English text is the input to the parser: 

In the beginning of the story Duncan was a king. Macbeth was a happy 
noble. He married Lady-Macbeth. She was a greedy and ambitious 
woman. She wanted Macbeth to be king. He also desired to be the king. 
Lady-Macbeth persuaded him to murder Duncan. Soon Lady-Macbeth 
decided to kill herself. Macduff was a loyal noble. He became angry. 
MacbetlTs murder of Duncan caused him to kill Macbeth. 

Below follow the frames which were generated after parsing the input text. Here, AKO stands for 
A-KIND-OF, and HP - for HAS-PROPERTY relations. 

(DUNCAN (ako (KING))) 

(MACBETH (ako (NOBLE) (KING (ako-1))) 

(hp (HAPPY)) 

(marry (LADY-MACBETH)) 
(desire (ako-1)) 
f~S (murder (DUNCAN (murder-1)))) 
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(LADY-MACBETH (ako (WOMAN)) 

(hp (GREEDY) (AMBITIOUS)) 

(want (ako-1)) 

(persuade (murder-1)) 

(kill (LADY-MACBETH (kill-1))) 

(decide (kill-1))) 



(MACDUFF 



(A KOI 



(MURDER-1 



(KILL-1 



(KILL-2 



(ako (NOBLE)) 

(hp (LOYAL) (ANGRY)) 

fkill (MACBETH (kill-2)))) 

(frame (MACBETH)) 
(slot (AKO)) 
(value (KING))) 

(frame (MACBETH)) 
(slot (MURDER)) 
(value (DUNCAN)) 
(cause (KILL-2))) 

(frame (LADY-MACBETH)) 

(slot (KILL)) 

(value (LADY-MACBETH))) 

(frame (MACDUFF)) 

(slot (KILL)) 

(value (MACBETH))) 



/— *\ 
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